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Abstract 

Consider a state of a system with several subsystems. The entropies 
of the reduced state on different subsystems obey certain inequalities, pro- 
vided there is an equivalence relation, and a function measuring volumes 
or weights of subsystems. The entropy per unit volume or unit weight, the 
mean entropy, is then decreasing with respect to an order relation of the 
subsystems, defined in this paper. In the context of statistical mechanics 
a lattice system is studied in detail, and a decrease of mean energy is de- 
duced for blow-up sequences of regular and irregular octogons. 

PACS numbers: 05.50.-hq, 03.67.-a, 02.10.Ab 



1 Introduction 

Entropy is a key concept in several areas, from thermodynamics to dynamical 
systems. The study presented here refers primarily to statistical mechanics, but 
it may also be considered in the context of information and quantum information 
theory. See, for example, [[NCOCI|] for the basic setup needed to implement results 



of this paper. The problem studied in this paper, comparing entropies of subsys- 
tems, is presented in the context of statistical mechanics first, then it is stated in 
a formulation refering to (quantum) information theory. Both presentations are 
rather abstract, but yet not as general as would be possible. It turns out that the 
methods which will be used are very flexible, so they may be applied also under 
different cicumstances. This will be remarked at some places. 

Consider a quantum lattice system, defined with a state on the inductive limit 
of local algebras of observables. Assume that a density matrix and an entropy 
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S{A) is assigned to each restriction of this state to any local algebra Aa belonging 
to a finite subset A of the lattice. If the state is invariant under translations, and if 
i? is a "translate" of A (meaning, that there exists a translation, mapping Ato B), 
we know that S{B) = S{A). Now we are interested in relations between entropies 
assigned to different sets, with possibly different measures fJ^iA). One knows for 
some time already, see Propositions 6.2.25 and 6.2.38 in [ pR8 1|| , and [|ABK01|| 
with the references quoted there, of a subadditivity, a strong subadditivity, a 
triangle inequality, and a "strong triangle inequality" for entropies, and of the 
existence of the van Hove limit of the mean entropy, the entropy per unit volume 
(also called "entropy density") 

s{A) = S{A)/fi{A). (1) 

All these assertions are true in case the local algebras Aa are represented on local 
Hilbert spaces Ha with the product property 

Hd = 'Ha0'Hc, if D = AUC and A n C = 0, (2) 

and the density matrices fulfill the compatibility condition 

PA = TtcPd, if D = AuC and AnC = (l), (3) 

where pa represents the state on the local algebra Aa- See |[LK73a|| for a listing 



of fundamental properties of entropy related to the product property of algebras, 
from which all the above assertions follow. See also | |W 78|| for properties of 



entropy, and for a proof of encrease of entropy of lines of increasing length in one 
dimensional translation invariant systems. 

Then it has been established for mean entropy in ||ABK98|| that s{A) > s{B), 



if A and B are rectangular boxes or parallelepipeds with A G B. In the same 
electronic "paper" the question has been raised, whether this relation of mono- 
tonicity can be extended to all pairs of sets with A d B. Here in the present 
paper, in the Appendix, we will answer this question in the negative, by giving 
counterexamples, considering systems with spins on W?. But we can neverthe- 
less make some progress concerning "Question 1" of |ABK(J1]: We extend the 



monotonicity property of s{A) from rectangular boxes to more general volumes. 

To enable this quest we define an order relation between sets, adapted to 
imply monotone decrease of mean entropy. The formalism of this method is 
not tied to lattice systems. All we need is an equivalence relation between sets, 
corresponding to an invariance property of the state, as for example translation 
invariance. To define the mean entropy we need of course a measure. Then we 
will need nothing more but the strong subadditivity of the entropy as a function 
of sets, 

S{AuB)<S{A) + S{B)-S{AnB), (4) 

which is a consequence of the strong subadditivity proven in [[LR73b|| , and of the 
product property (13). (It is also true for fermionic systems with a modification 
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of the product property, |[AM01|| .) We remark that we do not need positivity of 
the entropy. So our results are true for classical continuous systems as well. 

Refering to quantum information, consider information stored in an assembly 
of several elementary quantum systems. Consider also subsystems of the total 
system, defined by subsets of the total set of elementary systems. Each subsystem 
A, and the information it carries, is represented on a Hilbert space Ha with 
a density matrix pA, obeying the product property (|^) and the compatibility 
condition (j^). To any subsystem A a weight p{A) is assigned. These weights 
fulfill the conditions for a measure on the family of subsets {A, B, . . .}: < 
IJ,{A) < 1, fi{A U B) + n{A DB) = n{A) + fi{B). Assume moreover, that this 
system is equipped with an equivalence relation on the family of subsets, which 
is compatible with the assignement of a mean entropy, the entropy per weight, so 
that "A' equivalent to A" implies S{A') = S{A). (It is not necessarely compatible 
with the assignement of a weight.) Now we are interested not only in the von 
Neumann entropy S{A), but also in the mean entropy, the entropy per unit 
weight, defined in (|ip. When can we be sure, that s{A) > s{B)7 Also this 
question can be answered with the help of the order relation to be defined in 
section using nothing more but the strong subadditivity (1). 

The definition of partial ordering is given in axiomatic form, with axioms 
defining the process how to construct the order relation step by step. We take 
some care of the logic in this process: Examples demonstrate both the use of 
these axioms, using subsets of a two-dimensional lattice, and their mutual logical 
independence, that is, that no axiom is a consequence of the others. Each step in 
the creation of such an order relation is consistent with monotonicity of the mean 
entropy. This fact is a consequence of strong superadditivity it is stated and 
proven in Theorem |^ and its proof, in section ^. Finally, we present an application 
of this method in the context of statistical mechanics, creating an order relation 
for convex octogons in Z^. Their ordering is related to simple inequalities for the 
pieces of the boundaries, as stated in Definition ^ and in Theorem ^ It includes 
the ordering of blow up sequences of octogons, and implies the monotone decrease 
of mean entropy. 



2 The partial ordering 

Consider a space (set) Ai, with a family of subsets which is closed under 
forming unions and intersections of pairs, and an equivalence relation ~ on JF. 
A partial ordering -< on is defined by the following axioms: 

(I) li A ^ B, A A' and B ^ B' , then also A' ^ 5 and A ^ B' hold. 
(Invariance) 

(II) If An5 is empty, and if either A B oi A -< B holds, then A -< D = A\JB. 
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(III) UADB ^B, and if either A B or A ^ B holds, then A^D^ AUB. 

(IV) U A n B = C < D = A U B, and if either A B or A -< B holds, then 
A^D. 

(V) If BnC = A^ B and also A^C hold, then A ^ = U C, even if B 
is not comparable with C. (i.e: Neither B ^ C, nor B -< C, nor C -< B 
hold.) 

(VI) If A -< B and 5 -< D, then also A -< D holds. (Transitivity) 

To enable a precise referencing, we subdivide the second, the third and the 
fourth axiom: 



(11) 


(a) 


AnB 


= 0andA~S =^ A^ D 


^AUB 




(b) 


AnB 


= 0andA-<5 =^ A<D 


= AUB 


(III) 


(a) 


AnB 


= C^BandA^B =^ A 


-<D = AUB 




(b) 


AnB 


-<B and A^B =^ A 


<D^A[JB 


(IV) 


(a) 


AnB 


^ C ^ D ^ AU B and A ^ B 


A^D 




(b) 


AnB 


^ C ^ D ^ AU B and A ^ B 


A^D 



The condition of uncomparability is included in the fifth axiom to keep the 
axioms mutually independent; but this condition can be ignored in applications: 

1. LEMMA. Let A = B n C , A ~< B, A ^ C and either B C or B ^ C. 
Then A ^ D = BU D. 

Proof. Use axioms Ilia and VI if S ~ C, axioms Illb and VI if S ^ C. □ 

On the other hand, allowing equivalence of B with C in axiom V would make 
the order relation stated in axiom llla a consequence of axioms I, V and VI. 

There are in principle two different ways in using these axioms. One possibility 
would be to "import" an order relation between sets, "dictating" it, and then 
extending it. In this paper however we are concerned with the other way of 
starting from scratch, creating the ordering out of the equivalence relation, by 
forming unions and checking for order relations concerning the intersections. We 
state an immediate consequence of using this creative process: 

2. LEMMA. // the ordering is created in a countable number of steps, then 
A ^ D implies that there exist sets A^^\..A^^^ which are equivalent to A, such 



that 



N 




(5) 



n=l 
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Proof. We may order the sequence of logical steps leading to A -< D in such a way, 
that in the n'th step, establishing ... -< B^"'\ only the relations established in the 
former steps are needed. Going backwards from A -< D, we see that D and each 
B^"'^ has to be represented as the union of two sets, B^'^^ and B^^\ which are either 
equivalent to A or are ordered like A -< B^'^\ Then we proceed by induction. The 
basis of the creative process is the axiom Ila. It is the only one, which does not 
need a pair of sets which are already in an order relation. So B^^^ = A^^^ U A^'^\ 
We assume that A -< B^'^^ for u < n ~ 1 has been established. Now either a 
similar procedure as in step one may occur in step n, or the existence of one or 
two of the former relations is needed. Checking the axioms it is obvious that 
the property (|^) propagates from the -B^^^ to -B*-"-* in the process of establishing 
A -< □ 

It is to be remarked, that (|^) is not a sufficient condition for A -< D. In the 
Appendix we will present a counterexample, combined with s{A) ^ s{D). 
The following may in applications apply to the empty set: 

3. COROLLARY. If a set Z is not equivalent to any other set, then no relation 
Z -< D can he established. 



3 Logical independence of the axioms and ex- 
amples of applications 

The axiom of invariance has a special status, just enabling full power for the other 
axioms in creating the order relation. Especially axioms lib and IVb would have 
no meaning at all without this invariance. Without it, order relations can only 
be established between sets where one of them is a subset of the other one. This 
can be seen by inspection of the "creative" axioms, II to V. So the independence 
of this axiom is obvious. 

Now we demonstrate the independence of the other axioms, II to VI, - with 
one exception - on examples for each one of them, where an ordered pair would 
not be comparable without it, i.e. we present each time an order relation A ~< D, 
which can not be created without this axiom. The exception is axiom lib. If the 
ordering is created in a countable number of steps, starting with axiom Ila, then 
the assertion of axiom lib is a consequence of axiom V in its generalized form. 
This strange fact is now being stated as Theorem ^. Nevertheless we will present 
two simple examples of how to use axiom lib. 

4. LEMMA (Deduction of lib). If the ordering is created as stated above by 
the axioms I... VI, the assertion of axiom lib is a consequence of the other axioms. 

Proof. Axiom lib assumes A ~< B and A fl i? = 0. By Lemma ^, -B is a union of 
sets A*^"^ which are all eqivalent to A. Now define C = AU A^^\ observe A ^ C 
by Ila, and use Lemma |l|. □ 
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Examples 



In our system the two-dimensional lattice 7? is the space M., the finite subsets 
of form the family and the discrete group of two-dimensional translations 
maps each set A to all equivalent sets A' ~ A. To make the notation short, 
we denote those points of we need like the squares of a chessboard, i.e. al 
instead of (0,0), c4 instead of (2,3) etc. In the pictorial presentation of these 
examples the points are represented by squares, and the point al (which may be 
also outside of A) is marked with a cross. 



(Ila) A^W^D^ !iiU; also 
A = {al} ^ B = {hi}, so 
A -< D = AU B = {al,61}; 



and also 



-< 



also {al} -< {al, a2}; and also {al, hi} -< {al, 61, a2, 62} 

□ 



(lib) A= X -< D = [2iiJ; also x -< 
A = {a2} -< D 
D = {al, W,a2}, 

with B = {al,61}, 

and A -< B hj the order created above and the invariance property. 

Also A = {a2, h2} ^ D = {al, 61, cl, a2, 62}, with B = {al, 61, cl} and the 

ordering A ^ B created in the following example. 



(Ilia) A 



with B 



-< D -- 
A = {al,61} -< D 
D = {al,61,cl}, with 
S = {61,cl}, C = {61}, 
and with the order C ^ A ~ S created with Ila. 



and C 



(nib) 













X 







with B — 









X 







A^ X ^ D = 
A = {aL61,a2} -< D 
D = {al, hi, cl, a2, 62, a3}, with 
B = {al,61,cl,a2,62}, 
C= {a2,62}, 

and the order C ~< B created with lib and Ilia. 



and C = X 



(IVa) 



















i X 




J ^ D = [.x 






J with S = xF 




1 RTid r7= x| 1 



A 

A = {al,61,cl,62} -< D 

D = {al, hi, cl, dl, 62, c2}, with 

B ^ {hl,cl,dl,c2}, C={61,cl}. 

The order C ^ D can easily be seen to follow from Ila and lib. 
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(IVb) 











........ 




























V 




and C = X 



A = -< D = X with B 

A = {a2, 61, 62, 63, c2, c3} ^ D with 
D = {a2, a3, 61, 62, 63, 64, cl, c2, c3, c4, rf2, ci3}, 
5 = {a3, 62, 63, 64, cl, c2, c3, c4, rf2, c/3}, 
C = {62,63,c2,c3}. 

Relation A -< B is a consequence of axiom Ilia, using B = A' U A" , where 
A' = {62, cl...} and also A" = {a3, 62...} are translates of A, and A' DA" = 
{62, c3} ^ A by applications of Ila and lib. The relation C D can be 
proven with Ila and Ilia. 



(V) 



-< D 





























X 































X 







and C 



with B 

{a3, 63, cl, c2, c3, dA} -< D with 
{a3, a4, 63, 64, cl, c2, c3, c4, dl...d5, e4}, 
{a3, a4, 63, 64, cl...c4, dA, d5}, 
{a3, 63, cl, c2, c3, dl.-.di, e4}. 
Relation A -< B is a. consequence of axiom IVa, using B = AU A', where 
A' = {a4, 64...} is a translate of A, and An A' = {c2, c3} -< -B by repeated 
application of Ila and lib. The analogue procedure proves A ^ C. 



(VI) 













X 





-< 



B 































X 









-< D 

{al,a2,62,c2,c3} -< D, with 
{al, a2, 61, 62, c2, c3, c4, d2, d3, dA, e4, e5, /4, /5}, 
and with the intermediate set 
B = {al, a2, 61, 62, c2, c3, d2, d3}. 

The relation A ~< B is established with IVa, because of B 
where A' = {61,62...} is a translate of A, and A (1 A' -< B. Relation 
B -< D is established with either Ilia or IVa, because of -D = BU B', where 
B' = {c3, c4...} is a translate of B, and B n B' -< B or B n B' -< D. 



A U A\ 



To see the necessity of the axioms, their logical independence, one has to 
see in each case, that the order relation does not follow from the application of 
another axiom instead. Here Lemma ^ helps. It is easy in each example, to find 
out all the sets A', A", ... which are eqivalent to A and subsets of D, and then 
to test all the chains A -ilA' U A" -<?... -<7D. For the examples to Illb and 
IVb there are several ordered chains, but one has always to use the special axiom 
which is just under inspection. 
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4 Monotonicity of mean entropy 

5. THEOREM (Monotone decrease). Assume that equivalent sets have the 
same mean entropy. Then mean entropy is monotone decreasing: 

A^D^ s{A) > s{D) (6) 

Proof. We write the strong subadditivity of the entropy as a relation for the mean 
entropy: 

s{AuB)<\as{A) + \bs{B)-\cs{C) (7) 
where we denote An B = C, as in the axioms II, III and IV, and use 

/i(A) __KB)^ . KC) 

^^"M^uE)' ^^-M^u5)' ^^"M^uE)- 

Note that < Ac < min{AA, As} < 1 and A^ + As = 1 + Ac- In case A n 5 = 0, 
we define Xcs{C = 0) = 0, in accordance with the simple subadditivity of the 
entropy (which would be sufficient to check axiom II), 

S{AUB) <S{A) + S{B). (9) 

Now we proceed in an inductive way along the process of creating the ordering, 
similar as we did in the proof of the Theorem ^. We check each axiom, and 
assume that the inequality @ holds for the pairs of sets which are assumed to 
be in an order relation already. 

(I) Equivalent sets have the same mean entropy, so the inequalities are invari- 
ant. 

(II) We have Aa + A^ = 1, s{B) < s{A), hence s{D) < Xas{A) + Xbs{B) < s{A). 

(III) Now s{C) > s{B), s{B) < s{A), so s{D) < Xas{A) + Xbs{B) - Xcs{C) < 
XAsiA) + (Xb - Xc)s{B) < {Xa + Xb- Xc)s{A) = s{A). 

(IV) Here s{C) > s{D), implying s(L') < Xas{A) + Xbs{B) - Xcs{D) s{D) < 
(Aas(A) + Xbs{B))/{1 + Ac), and s(5) < s{A) s{D) < s(A). 

(V) Here we have s{D = B U C) < Xbs{B) + Xcs{C) - Xas{A), s{B) < s{A), 
s{C) < s{A) and As + Ac = 1 + Xa, which obviously implies s{D) < s{A). 

(VI) Transitivity is obvious. 

□ 

It occurs as a surprise, that we had not to assume equivalent sets to have the 
same measure, as it is naturally the case in all our examples. 
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5 Octogonal sets in a two-dimensional lattice 

We extend the monotonicity of mean entropy, known for rectangular boxes, to 
the family O of convex octogonal sets. O is defined as consisting of all those finite 
convex subsets of Z^, whose boundaries are horizontal, vertical and diagonal lines, 
with some exceptions: Excluded are oblique rectangles. (But oblique straight 
lines are elements of O.) We characterize each set A in (9 by the coordinates of 
the most left point in the lowest line, and by a sequence of eight non negative 
integers, (m, n,p, . . .u), which describe its boundary b^i. The length of the lower 
horizontal boundary is m, the other boundary lines follow counter clockwise, with 
the lengths n\/2,p, . . .uV2. The following drawings show a set A, each point in 
7? represented by a square, and its boundary = (4, 1, 2, 2, 1, 3, 1, 1): 




Note that the boundary fines are included in the set. 

Since the boundary is a closed curve, the parameters have to obey 

u + m + n = g + r + s, (10) 
n + p + q = s + t + u, (11) 

and for each sequence of 8 non negative numbers obeing these relations there 
exists a boundary. The length of any boundary line (or of more boundary lines) 
may be zero. Then two (or more) corners, otherwise at the endpoints of this 
boundary line, coalesce into one. Octogons which are "Lines" have two pieces of 
boundary (representing two opposite directions of the boundary curve) . A special 
boundary is = (0, 0, . . . , 0), characterizing elementary sets, the "atoms". 

Again we define a set A' to be equivalent to A, if and only if A' is a translate of 
A. An equivalence class of octogons is obviously characterized by the boundary, 
which is common to all of the members of the equivalence class. Moreover, and 
to show this is the goal of this section, the ordering of the octogons corresponds 
to an ordering of the boundaries. 

6. DEFINITION (Ordering of boundaries). Boundary h a = {mA,---UA) 
is said to be piecewise shorter than = {rriB, ■ ■ - Ub), denoted as < hs, if 
bA 7^ bs and tua < rnB, ua < ■ ■ - Ua^ ub- 

7. THEOREM (Ordering of octogons). Two octogons, A and D, elements 
of O, are in the order relation A ~< D, if and only ifhA < hn. 
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This ordering includes blow-up sequences: Let A,y be characterized by the 
boundary z/b^ = (z/m, un, . . . uu), with u a positive integer. Then u < it imphes 

Proof. One direction, assuming A -< D, is easy. By Lemma 0, D is a union of 
some translates of A. So each boundary line of D contains the boundary line of 
at least one of these translated sets and can thus not be shorter. The proof of the 
assertion in the other logical direction fills the remaining part of this section. □ 

Consider the circumference of a boundary 

e{D) =mD+PD + rD + tD + V2{nD + qD + SD + Ud). (12) 

Each finite interval in M contains only a finite number of such lengths, so they can 
all be numbered and ordered as ii < £2 < ■ ■ ■ < C-n < ■ ■ ■■ The proof will be by 
induction on the circumference i{D), this is, by induction on N. Since i{E) = 
holds for the atoms only, with no other boundaries piecewise shorter than hE 
existing, there is nothing to prove at the start of the induction. The induction 
hypothesis is, that < and i{B) < i{D) imply already A B. Now, if 
byi < and if, concerning the ordering, there are other boundaries in between, 
byi < . . .bfi < ho, then i{B) < i{D), and it remains to prove B ~< D only. In 
other words, we assume that there are no other boundaries between and b^i. 

Since the linear relations (p!0| ) and (^) hold for both b^ and ho, they hold 
also for the piecewise difference b/j — b^ = (m/j — m^, . . .), and this difference 
can be interpreted as boundary bjvf of a "molecule" M, a set which is in the 
ordering one level directly above the atoms, with no other set in between. It 
is not difficult to find out that there are exactly twelve equivalence classes of 
molecules in O, which can be grouped into four types. Representatives of these 
types are: 



Ml = {al, a2} = LJJ , M2 = {a2, 61} 



M3 = {al, a2, 61} = _Li, M4 = {al, 61, 62, cl} 



Each of these sets represents an equivalence class, and, together with the equiv- 
alence classes defined by its one rotated version or three rotated versions, it 
represents a type. 

There is a relation between the sets Mj and the process of constructing D out 
of A. 

8. DEFINITION (Convolution of sets). Let A = {a^, 1 < i < I}, C = 
{cj, 1 < j < J}, then the convolution of A with C is 

A*C = {sii + Cj,l <i < 1,1 < J < J}. (13) 
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9. LEMMA (Convolution is Addition). If A and M are octagonal sets in 
O, hut not orthogonal oblique lines, then D — A * M & O and = + bM- 

Proof. It is not difficult to see, that D is a convex set. (This would not be true, 
if A and M were oblique orthogonal fines, so we excluded this case; and we have 
no oblique rectangular boxes in O.) Consider a boundary line {aj,i G LincA} 
of A and the corresponding boundary line {x^, j G LineM} of M, f.e. the lower 
horizontal boundary lines, with lenghts rriA and rriM- (If its length happens 
to be zero, it consists of one point, f.e. the lowest point in the set.) Then 
{cij + Xj,i e Line A, j £ LineM} is the corresponding boundary line oi A * M, 
and its length is tua + thm- □ 

The convolution of A with an atom produces a translate of A, 

A * {xi} = A^'^ - A, (14) 

so, for M = Ui{xi}, 

a*m = |Ja«. (15) 

i 

Now we are ready to apply the axioms and perform the step of induction. 

10. PROPOSITION. Let b^ < bp, and A * Mi ^ D, for A e O and one of 

the twelve molecules M,. Assume that he < hs and i{B) < i{D) together imply 
C ^B. Then D e O and A ^ D holds. 

Proof If A is an atom, then ^ * Mj = Mj or A * Mj ~ Mj, and A ^ Mi hy axiom 
Ila. 

For larger sets we have to treat different cases differently; but since the system 
is invariant under 90-degree rotations, it is sufficient to prove this proposition 
with the molecules Mi . . . M4. With (m, n, . . .u) we denote the boundary of A. 
Assume that the point al is the origin. 

Convolution with Mi : 

A * Ml is the union of A with A', where A' is A translated by one step to the 
right. We have to investigate, whether C = ACl A' is empty or whether it can be 
compared with A or with D. This depends on the form of A in the lowest and in 
the highest region: If A is not a vertical or oblique line, we say that the bottom 
of A is 

o fiat, if m > 1; 

o sharp, if m = 0, and either u — and n > 1 or vice versa; 
<> rectangular, if m = 0, w > 1 and n > 1. 
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Analogously we denote the top, with u,m,n replaced by q,r,s. The following 
pictures show the sharp top of some A and the corresponding top of D with C 
inside marked with crosses, and the same for some A with a flat top. 





















X 












X 


X 



^flat 













X 


X 














X 


X 


X 



(16) 



A is a vertical or oblique line: ^4 fl ^4' = and A ~< D hy axiom Ila. 



Top and bottom are sharp: A is either a parallelepiped, or an equilateral 
triangle, where the vertical hue is the "base", or a trapezoid, also with 
the vertical hne as the base. We have mc — and also qc — 0, all the 
nonvanishing adjacent border lines of C arc shorter than the corresponding 
border lines of A, so C can be compared with A: he < b^, which implies 
C -< A. With axiom Ilia we infer A -< D. 



Example: A 





















V 










X 















, with C inside. 



Bottom is flat, top is sharp, or vice versa: If m > 1, then mc = m — 1; 
the top of C is sharp with adjacent border lines shorter than those at A, 
as in the above case. Other border lines of C have the same lengths as the 
corresponding lines of A. So C ^ A, and we use again axiom Ilia. If m = 
but r > 1, the same argument is true, with top and bottom exchanged. 



Example: A 





















X 














X 


X 








■<D = 




X 







with C inside. 



Top and bottom are flat: (Horizontal lines and rectangles are here included.) 
Both mc — m — 1 and rc — r — 1 hold, with the other border lines of C 
with the same lengths as those oi A. So again C ^ A holds and axiom Illa 
is applicable. 



Example: A 













X 














X 


X 


X 





with C inside. 



Now, if m = r = 1 and p — t — 0, the set C is an oblique rectangle, not in 
O. It is nevertheless true, that C ^ A, as is shown under the item "Top 
and bottom are rectangular" . 

If one of the extremal regions is rectangular, C can not be compared with 
A. Either mc = 1 while m = 0, or r^- = 1 while r = 0, or both. The picture 
shows the rectangular top of some A, the top of D with C inside, C marked with 
crosses, and the top of a set F which is needed in the proof. 



^rectangular — 



















>< 


X 








X 


X 






X 


X 


X 


X 




X 


X 


X 


X 



(17) 
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So, to prove A D one has to use axiom IVa, and establish the ordering C ^ D 
first. In any case one has, to estabhsh C ^ D, to construct a set F G O, with 
F C D, i{F) < i{D), and be < hp, so that C -< F by assumption (the induction 
hypothesis to prove the theorem). Then one has to use a set C ~ C, such that 
= C" U F and G = C" n F -< F (or G = 0), which imphes C -< D hy axiom 
Illb (or by axiom lib). 

• Top is rectangular, bottom flat ( or vice versa): F is the union U C U C^, 
where C" is C translated one unit to the left, C"*" is C translated one unit 
to the right. So F = C * {zl, al, 61}, with zl denoting the point left of al. 
We discuss the case with the rectangular top, the other case is analogous 
by reflection. We move C one unit upwards, denote this set as C, and 
observe D = F U C, see figure (|1^. The simplest case is just that of the 
example to axiom IVa in Section ^. In this case F fl C" = 0, so axiom lib 
makes the proof oi C ~< D complete. For any larger A also C is larger and 
G = F n C" 7^ 0. By inspection of figure ([T7|) one sees that tq = rp = 3, 



qg = Qc ~ ^1 sg = Sc — ^- The other border lines have the same lengths as 

those of C . Since he <hp, we have < b^?, and G -< F. 

Example: 



A 



-<D{C inside) 



















X 


X 






X 


X 


X 


X 






X 


X 


X 


X 








X 


X 


X 


X 






X 


X 


X 


X 








X 


X 


X 








X 


X 


X 




. F = 













G inside. 



Top is rectangular, bottom sharp (or vice versa): F = C * H , where H = 
{zO, zl, aO, al, hi} {aO denotes the point below al, etc.) is equivalent to the 
bottom of D: 



bottom{D) - 

F & O since C & O and H E O. The remaining procedure is as above: We 
construct C' = C * {a2}, G = C' HF, so that D = G' U F, and observe 
T^G = = 3, qc = Qc ~ 1) = ~ 1- The other border lines have the 
same lengths as those of G. Since be < hp, we have be < hp, and G F. 
This implies G ~< D. 
Example: 



A 



-<D{G inside) 













X 


X 






X 








X 




















. F = 











G inside. 



Top and bottom are rectangular: The bottom of D with G inside is like 
the bottom in figure (|1^) upside down. H is defined accordingly as H = 
{zl, al, 61, aO} e O. It follows that F = G*HeO,G^F. Again we use 
G' = G * {a2}, and perform the same procedures as in the last two cases. 
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Example: 



A 



-<D{C inside) 















X 


y 








X 


X 






X 


X 


















, F = 











G inside. 



Since it is needed at another place, we observe that the same procedure can be 
applied also if A is an oblique rectangle, because also in this case C G O and 
DeO. 



Convolution with M2 : 

A * M2 is the union oi A' = A* {hi} with A" = A* {a2}. 

The case A' fl A" = happens if A is a horizontal or a vertical line, or a 
narrow oblique strip perpendicular to M2, where the border of A has g = m = 0, 
and either m = and t = 1 or m = 1 and t = 0. In these cases axiom Ila applies. 
Note that using oblique lines rectangular to M2 is forbidden. (See the remark in 
the proof of Lemma |^. ) 

If C = y4' n A" is not the empty set, it is always a precursor of A in the 
ordering. To see this, one has to check the lower left end and the upper right 
end of A. We define the types for the lower left end, with obvious analogues for 
the upper right ends by symmetry. The pictures show again each type of end for 
some A, and the corresponding end of D with C inside marked with crosses. 



sharp ends: Either m > 2, s > 1, t 
tc = uc = 0, 



u 



0, so that mc 



m — 1, 



A 



sharp 



D 













X 








X 


X 






X 


X 


X 













(19) 



or t > 2, n > 1, m = u = 0, and tc = t — 1, mc = Uc = 0. 

The length sc (or nc) is also shorter than s (or n); how much shorter it is 
depends also on the other end. 

rectangular ends: u = 0, m > 1, t > 1, so uc = 0, mc = m — 1, tc = t — 1. 



A 



rectangular 



D 











X 


X 




X 


X 


X 











(20) 



flat ends: u > 1, so uc = u — 1, mc = m, tc = t. 



A 



flat 



D 





X 








X 


X 






X 


X 









(21) 
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If no end is sharp, both nc — n and sc — s. Otherwise at least one of these 
border hnes is shorter than those of A. In any case, be < b^, so C ^ ^4, and 
axiom Ilia apphes, proving A ^ D. 



Example: 

















X 




r 
1 
1 




X 


X 


X 

















J, C inside. 



Convolution with M3 : 

• Lines: If ^4 is a vertical line, {A * {bl}) n{A* {al, a2}) = 0, and axiom lib 
applies, using D= (A* {bl}) U{A* {al, a2}) and A^ (A* {al, a2}). For 
lines in other directions, the same argument applies, with the three points 
from M3 appearing in appropriate permutations. 

In the other cases, the types of the bottom and of the left side of A dictate the 
way of proof, whether axiom Illb can be used, or whether IVb is necessary. The 
types of the left side are defined in the same way as the types of the bottom, 
rotated by 90 degrees: Flat means t > 1, rectangular means t = 0, m > 1, u > 1, 
and sharp means t = with either s = 0, r > 1, u > 1, or u = 0, m > 1, s > 1. 

• Left side is flat: t > 1. Define B = A * Mi. By assumption A -< B, 
since i{B) < i{D). Observe D = A' U B, with A' = A * {a2}. Then 
C — A' f] B ^ B has to be shown. If s > 1, then sc ~ s — 1, otherwise 
tc — t — 1. On the right side: li q > 1, then qc — q — 1; ii q — 0, p > 1, 
then pc — p — 1; if p = q = 0, then n > 1, nc = n — 1. In all cases, vc < r, 
so he < hs and C ~< B. By symmetry of the system and of the molecule 
M3 under reflections at a diagonal, the proof for the cases with flat bottom, 
m > 1, is analogous. The example for the axiom Illb is an example for this 
case. (What there has been termed A is here A':) 

• Left side is sharp: Since the cases with m > 1 can be treated in the way 
described above, we assume m = 0. Also the hnes have alresdy been con- 
sidered, so we have here u>l,s — Q,r>l. Also here B — A* Mi, A' and 
C defined as above. On the left side we observe uc = u — 1, on the right 
side the inequalities for different cases are as above. So again C -< B holds, 
and axiom Illb applies. 



Example: A 





X 











with C inside. D 



• Left side and bottom are rectangular: It is necessary to use B = A * M2. 
Also in this case A -< B. We have to investigate on C = A r\ B. The 
left side and the bottom are: tc = 1, mc = 1, uc = u — 1, sc = s — 1, 
Tic — n — 1. The other border hnes have the same lengths as in A. Form 
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F = C*H, with H = {zl, al, a2, 61} = LXI]. (The point {al} is marked 
with a cross.) Represent D = {C * {a2}) UF, observe C -< F. So, by axiom 
Illb, C -< D, and axiom IVb imphes A -< D. The example for axiom IVb 
is an example for this case. 



Convolution v^^ith M4 : 

Define B = A* {zl, al, 61}, A' = A* {a2}. So D = A' U B. If A is a horizontal 
line. A' n B = ^ and axiom lib applies. For the other cases it is easy to see 
C = A' nB B: Observe rc < tb- For the left side, consider the sequence s, t, u 
of border lengths in A. The first one, which is not zero, is shorter by one in the 
set C. The analogue is true for the right side, considering q,p,n and qc,Pc,nc. 
Obviously mc = m. So C ^ B, and axiom Illb applies. □ 



6 Remarks on continuum systems 

Consider a translation invariant state on the inductive limit of local algebras {^a} 
on bounded convex measurable subsets {A} of M^. Assume that the system fulfills 
the product property (0) and the compatibility condition (^. Impose moreover 
a continuity condition, which enables an approximation of an octogon A in 
and the state restricted to {Aa} by sets Ai, and the states restricted to them, 
where the A^, are unions of small elementary squares, as shown in the figures of 
Section ^ in this paper. Then the statement of Theorem |^ can be carried over 
to the octogons in M^. Also an extension to higher dimensions, establishing an 
ordering of some sets in Z'^ and W^, seems to be possible. 

But these possible results are somehow unsatisfactory. Why just the octogons? 
If the monotonicity of mean entropy is true for sequences of octogons it is probably 
true for all kinds of convex sets. So 1 state now: 

11. CONJECTURE (Blow up sequences). Consider a system with all the 
properties stated above. Let A be a convex bounded measurable set in M."^, and 
define XA = {Ax; x G A, A > 0}. Then s{\iA) > s{\2A) if Xy < A2. 

The route to a proof of this statement might involve a stronger property: 

12. CONJECTURE (Ordering convex sets). Consider a system with all 
the properties stated above. Let A and B be convex bounded measurable sets 
in W^, and define 

D = A* B = {^ + y; ^eA,yeB}, (22) 
then mean entropy is decreasing, in the sense that s{A) > s{D). 
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Appendix: Negative answers to the question of 
A. Kay and B. Kay 

The system is again a two-dimensional lattice. To avoid a discussion of the ther- 
modynamic limit we consider some large box, with periodic boundary conditions 
for the interaction. The local Hilbert space for a single "elementary" site is 
C^. The system is now actually a classical discrete system, since we use only 
commuting operators: For each site a we use only the unit operator I and 

<^a=(j (23) 

Then we use products: 




Since the system is essentially a classical system, each state of such a system may 
be reinterpreted as a double periodic state of the infinite system on the lattice Z^: 
Any state is a probabihty measure on the set of configurations. Each configuration 
of the box can infinitely often be repeated periodically to give a configuration of 
the infinite system. Transfering a probability measure, which is invariant under 
translations of the box = torus, to this family of periodic configurations gives a 
translation invariant state of the infinite system. 

We stay close to possible apphcations in physics, considering states defined by 
short range interactions, symmetric under translations, refiections and 90-degree 
rotations. The states in the large box G are represented by density matrices 

p = e-'^^/Tre-'^^, (25) 

H a hamiltonian acting in Tic, 

H^Y^^A. (26) 
A&g 

where Q denotes any family of sets which is invariant under the symmetry group 
of periodic translations in the box G. The empty set is no element of Q. 

To enable a simple discussion of the restriction to a smaller set D, we consider 
very high temperatures, i.e. small /?. The partition function Tre"''^^ and all the 
expectation values TictbP are analytic functions of (3. 

Z(/3) =Tre-^^ = Z(0) + O(/3'), with Z(0) = 2"^^) (27) 



TrcTsp = -Z{Q)-^I31:y(TbH + 0{I3'^) for B^%. 



(28) 
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Note that TrascrA — 1 it B — A, zero otherwise. Therefore, from the Hamiltonian 
only the cr^ with sets A being subsets of D contribute to the expectation values 
of (Tb to first order in f3, when B d D. So the restriction of the state to the 
region D can be represented by a density matrix 

= e-^^^/Tre-^^^, (29) 

with a hamiltonian Hd acting in Hd, 

Hd^ '^a + Hd, (30) 

Aeg{D) 

with \\Hd\\ = 0{P), and where the family of interaction-multiplets is denoted as 

{Aeg,AGD}^g{D). (31) 

Now we can expand the mean entropy. The leading order is the same, sq — ln2, 
for each set. The terms of order (3 cancel, so we are interested in the terms of 
second order. 

s{D) = -ij{D)-'TipD\npD 

= l^{D)-^ (inTre-'^^^ + /3Tr[i/Be-'^^°]/Tre-^^^) 
= p{D)-^ (inTrl - \p^TiHl/Tie-^^^) + 0{f5'^) 

= So-\(5^p{D)-'Tr[Y, aAf/Tvl + 0{(3^) (32) 

A^g{D) 

Observe, that Tray^a^' = for A ^ A', and that a\ = I. So the calculation of the 
entropy S{D) up to order amounts to counting how many interacting pairs or 
multiplets of sites are contained in the set D, that is, the number of sets in g{D), 
which we denote as 

n{D)^\g{D)\. (33) 

Mean entropy is thus 

s{D) = so- lPMD)/^i{D) + 0{P'), (34) 

and for small /3 7^ 

s{B)<s{D) ^ n{B)/p{B) > n{D)/fM{D). (35) 
Now we are ready to answer some questions. Consider the sets 

r 



S = {al,a2,W} =L^J, C = {al, W, cl} = I 



D = {al,a2, W,cl} = 
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In comparing B with D, we consider an interaction of diagonally nearest neigh- 
bors, Q consisting of {al, 62}, {a2, 61} and its translates. Since n{B) = n{D) = 1, 
we have s{B) < s{D). 

In comparing C with D, consider Q as consisting of triples like C itself and 
its translates, and possibly also of the rotated triples and its translates. Since 
n{C) = n{D) = 1, we have s{C) < s{D). 

The last example can easily be generalized to a lot of cases, where a larger 
set does not have lower mean entropy: If C C -D, but no other set C equivalent 
to C is a subset of D, consider Q = {C ~ C} as the set of interacting multiplets 
and the interaction Hamiltonian defined as in (l2f 



We may now extend the set of questions posed in [|ABK01|| and ask: 
Question: Considering two sets C G D, is it necessary, that D can be repre- 
sented as a union of sets which are equivalent to C , to guarantee s(C) > s{D) 
for any invariant state? 

This property, D being a union of sets equivalent to C, is, alas, not sufficient. 
Here comes the counterexample promised after the proof of Lemma |^: Consider 
the sets 



C = {al, a2, 63, cl, c2} = L, and D = C U C -- 
with C = {cl, c2, d3, el, e2} being a translate of C. Q consists of pairs of nearest 
neighbors, A = {al,a2} and its translates, possibly also of the rotated pairs, 
B = {al,61} and its translates. The comparison gives 



lj{C) 5 " i2{D) 8' 



2 ^ n{D) 



(36) 



So s{C) < s{D) for small /? 7^ 0. As it has to be, because of Theorem ||, there is 
also no order relation between C and D. This comes from the intersection CnC 
being in no order relation, neither with C, nor with D. Moreover, this example 
can be extended. Translating C again and again, always the same distances, one 
can form chains of different length, = C U C" U . . . U C^^-*. With the same 
method, calculating n{D^^'^) / ii{D^^^) ^ one can prove that s{D^^^) is increasing 
in A^. 

With a state, which is not rotation invariant, it can be demonstrated, that 
oblique rectangles can not be ordered in the same way as the other orthogonal 
sets. Consider 



C = {a2, 61, 62,63, c2} = , and D = C U C 

with C = {z2, al, a2, a3, 62}, a translate of C. 

Q consists of pairs of diagonal neighbors, A = {al,62} and its translates. The 
comparison gives again ( p6|) and s{C) < s{D) for small /3 7^ 0. 
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